Exploiting Sequence Analysis for Accurate Light-Field Depth Estimation

نویسندگان

چکیده

Depth estimation for light field (LF) images is the cornerstone of many applications cameras, such as 3D reconstruction, defects inspection, face liveness detection, and so forth. In recent years, convolutional neural network (CNN) has dominated primary workhorse depth estimation. However, interpretability accuracy results still need to be improved. This paper uses conditional random (CRF) theory explain model LF Further, from perspective sequence analysis, we extract features epipolar plane image (EPI) patches with recurrent (RNN) serve unary term energy function in CRF. Then, a unified (called LFRNN) designed solve CRF get map. Our LFRNN builds upon two-stage architecture, involving local refinement. first part, design an RNN analyze vector sequences EPI obtain values. There are two thinking behind this part. The general principle that slope straight line inversely proportional depth; second our unique observation those lines distributed sequences. continuous used optimize output We train on synthetic dataset test it both real-world datasets. Quantitative qualitative validate superior performance over state-of-the-art methods.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Accurate Light Field Depth Estimation with Superpixel Regularization over Partially Occluded Regions

Depth estimation is a fundamental problem for light field photography applications. Numerous methods have been proposed in recent years, which either focus on crafting cost terms for more robust matching, or on analyzing the geometry of scene structures embedded in the epipolar-plane images. Significant improvements have been made in terms of overall depth estimation error; however, current sta...

متن کامل

Depth Estimation for Glossy Surfaces with Light-Field Cameras

Light-field cameras have now become available in both consumer and industrial applications, and recent papers have demonstrated practical algorithms for depth recovery from a passive single-shot capture. However, current lightfield depth estimation methods are designed for Lambertian objects and fail or degrade for glossy or specular surfaces. Because light-field cameras have an array of micro-...

متن کامل

Depth Estimation Through a Generative Model of Light Field Synthesis

Outline. We show our results on various datasets, including images taken with the Lytro by Tao et al. [2013] and our own dataset, images from the Stanford light field dataset [sta, 2008] and results on an artificial dataset [Wanner et al., 2013]. Furthermore, we expand on details such as the triangular function and the selection of the parameters. Finally, we discuss implications of our no-occl...

متن کامل

Depth Estimation of Light Field Images by Optical Flow

Light field images present a rich, compact, dataset of multiple images of a scene from slightly shifted viewpoints. I explore the use of an optical flow algorithm on light field images to estimate depth. The optical flow algorithm is simple to implement as does not require finding correspondences between images. Further, I explore the use of image priors and modern optimization techniques to fo...

متن کامل

Joint Blind Motion Deblurring and Depth Estimation of Light Field

Removing camera motion blur from a single light field is a challenging task since it is highly ill-posed inverse problem. The problem becomes even worse when blur kernel varies spatially due to scene depth variation and high-order camera motion. In this paper, we propose a novel algorithm to estimate all blur model variables jointly, including latent sub-aperture image, camera motion, and scene...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2023

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2023.3296800